artistic practice
PATCH: a deep learning method to assess heterogeneity of artistic practice in historical paintings
Van Horn, Andrew, Smith, Lauryn, Mahmoud, Mahamad, McMaster, Michael, Pinchbeck, Clara, Martin, Ina, Lininger, Andrew, Ingrisano, Anthony, Lowe, Adam, Bayod, Carlos, Bolman, Elizabeth, Singer, Kenneth, Hinczewski, Michael
The history of art has seen significant shifts in the manner in which artworks are created, making understanding of creative processes a central question in technical art history. In the Renaissance and Early Modern period, paintings were largely produced by master painters directing workshops of apprentices who often contributed to projects. The masters varied significantly in artistic and managerial styles, meaning different combinations of artists and implements might be seen both between masters and within workshops or even individual canvases. Information on how different workshops were managed and the processes by which artworks were created remains elusive. Machine learning methods have potential to unearth new information about artists' creative processes by extending the analysis of brushwork to a microscopic scale. Analysis of workshop paintings, however, presents a challenge in that documentation of the artists and materials involved is sparse, meaning external examples are not available to train networks to recognize their contributions. Here we present a novel machine learning approach we call pairwise assignment training for classifying heterogeneity (PATCH) that is capable of identifying individual artistic practice regimes with no external training data, or "ground truth." The method achieves unsupervised results by supervised means, and outperforms both simple statistical procedures and unsupervised machine learning methods. We apply this method to two historical paintings by the Spanish Renaissance master, El Greco: The Baptism of Christ and Christ on the Cross with Landscape, and our findings regarding the former potentially challenge previous work that has assigned the painting to workshop members. Further, the results of our analyses create a measure of heterogeneity of artistic practice that can be used to characterize artworks across time and space.
A Shift In Artistic Practices through Artificial Intelligence
Tatar, Kฤฑvanรง, Ericson, Petter, Cotton, Kelsey, del Prado, Paola Torres Nรบรฑez, Batlle-Roca, Roser, Cabrero-Daniel, Beatriz, Ljungblad, Sara, Diapoulis, Georgios, Hussain, Jabbar
The explosion of content generated by Artificial Intelligence models has initiated a cultural shift in arts, music, and media, where roles are changing, values are shifting, and conventions are challenged. The readily available, vast dataset of the internet has created an environment for AI models to be trained on any content on the web. With AI models shared openly, and used by many, globally, how does this new paradigm shift challenge the status quo in artistic practices? What kind of changes will AI technology bring into music, arts, and new media?
Is Writing Prompts Really Making Art?
McCormack, Jon, Gambardella, Camilo Cruz, Rajcic, Nina, Krol, Stephen James, Llano, Maria Teresa, Yang, Meng
In recent years Generative Machine Learning systems have advanced significantly. A current wave of generative systems use text prompts to create complex imagery, video, even 3D datasets. The creators of these systems claim a revolution in bringing creativity and art to anyone who can type a prompt. In this position paper, we question the basis for these claims, dividing our analysis into three areas: the limitations of linguistic descriptions, implications of the dataset, and lastly, matters of materiality and embodiment. We conclude with an analysis of the creative possibilities enabled by prompt-based systems, asking if they can be considered a new artistic medium.
Towards sustainability assessment of artificial intelligence in artistic practices
Jรครคskelรคinen, Petra, Pargman, Daniel, Holzapfel, Andrรฉ
An increasing number of artists use Ai in their creative practices (Creative-Ai) and their works have by now become visible at prominent art venues. The research community has, on the other hand, recognized that there are sustainability concerns of using Ai technologies related to, for instance, energy consumption and the increasing size and complexity of models. These two conflicting trajectories constitute the starting point of our research. Here, we discuss insights from our currently on-going fieldwork research and outline considerations for drawing various limitations in sustainability assessment studies of Ai art. We provide ground for further, more specific sustainability assessments in the domain, as well as knowledge on the state of sustainability assessments in this domain.
Does Artificial Intelligence Really Have the Potential to Create Transformative Art?
In 1896, the Lumiere brothers released a 50-second-long film, The Arrival of a Train at La Ciotat, and a myth was born. The audiences, it was reported, were so entranced by the new illusion that they jumped out of the way as the flickering image steamed towards them. The urban legend of film-induced mass panic, established well before 1900, illustrated a valid contention if the story was, in fact, untrue: The technology had produced a new emotional reaction. That reaction was hugely powerful but inchoate and inarticulate. Nobody knew what it was doing or where it would go. Nobody had any idea that it would turn into what we call film. Today, the world is in a similar state of bountiful confusion over the creative use of artificial intelligence. Already the power of the new technology is evident to everyone who has managed to use it.
Art in the Age of Machine Learning
An examination of machine learning art and its practice in new media art and music.Over the past decade, an artistic movement has emerged that draws on machine learning as both inspiration and medium. In this book, transdisciplinary artist-researcher Sofian Audry examines artistic practices at the intersection of machine learning and new media art, providing conceptual tools and historical perspectives for new media artists, musicians, composers, writers, curators, and theorists. Audry looks at works from a broad range of practices, including new media installation, robotic art, visual art, electronic music and sound, and electronic literature, connecting machine learning art to such earlier artistic practices as cybernetics art, artificial life art, and evolutionary art. Machine learning underlies computational systems that are biologically inspired, statistically driven, agent-based networked entities that program themselves. Audry explains the fundamental design of machine learning algorithmic structures in terms accessible to the nonspecialist while framing these technologies within larger historical and conceptual spaces. Audry debunks myths about machine learning art, including the ideas that machine learning can create art without artists and that machine learning will soon bring about superhuman intelligence and creativity. Audry considers learning procedures, describing how artists hijack the training process by playing with evaluative functions; discusses trainable machines and models, explaining how different types of machine learning systems enable different kinds of artistic practices; and reviews the role of data in machine learning art, showing how artists use data as a raw material to steer learning systems and arguing that machine learning allows for novel forms of algorithmic remixes.